{19 



J 



Europaisches Patentamt 
European Patent Office 
Office europden des brevets 




(5) Publication number : 0 577 363 A1 



Ci2) 



EUROPEAN PATENT APPLICATION 



@ Application number : 93305022.1 
@ Date of filing : 28.06.93 



(S) Int. ci.^ H04N 7/13, H04N 7/133 



CO 

<p 

CO 

in 



(So) Priority : 30.06.92 US 906787 

@ Date of publication of application • 
05.01.94 Bulletin 94/01 

(g) Designated Contracting States ; 
DE FR GB IT 

@ Applicant : LORAL AEROSPACE 
CORPORATION 
600 Third Avenue 
New York, NY 10016 (US) 



(72) Inventor : Wilson, Dennis L 
1325 Breenwood Avenue 
Palo Alto, CA 94301 (US) 
Inventor : Stenstrom, James T. 
877 Heatherstone Way 
518 Mountain View, CA 94040 (US) 

(g) Representative : Vaufrouard, John Charies 
Ellcington and Fife Prospect House 8 
Pembrolte Road 

Sevenoalcs, Kent TNI 3 1XR (GB) 



33 
•0 

O 



@ Compression and reconstruction of radiological images. 

(57) The present Invention provides for a com- 
pression scheme (10) tailored to the compres- 
sion of large radiological images processed 
with image processing workstations. The com- 
pression scheme (10) is a variation of the CCITT 
JPEG compression scheme with special care 
taken to suppress blocking effects of the 8x8 
discrete cosine transfonn used therein. In ac- 
cordance with the present invention, an original 
i'"I^3®/AV^ downsampled (12). then interpo- 
lated (14) back to its original size, resulting in a 
smoothed image (14a). The difference (13) be- 
tween the smoothed image (14a) and the origi- 
nal image (11) is then compressed (15) using an 
8x8 discrete cosine transform with 12 bit data 
Major artifacts present In the original image (11) 
are due to the mismatching of the low fre- 
quency components of the image at the edges 
of the blocks. When the low frequencies are 
removed by subtracting out the low frequency 
components, the artifacts disappear except in 
areas having very large dynamic changes. The 
compression scheme (10) of the present inven- 
tion IS particularly useful for archiving or tele- 
communicating images, achieving compression 
of more than 10:1 without losing the character- 
istics of the radiological image that pennit ef- 
fective diagnosis. A reconstmction scheme is 
also disclosed which allows recovery of the 
image (11) from a compressed image file. 
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BACKGROUND 

The present invention relates generally to radi- 
ological imaging, and more particularly, to image 
compression apparatus and methods for use in com- 
pressing and reconstructing radiological images. 

The medical imaging industry is a moving away 
from traditional film-based systems and is moving to- 
ward the use of digital images presented on computer 
work-stations. The images that are presented to radi- 
ologists must preserve the information contained in 
the original film images in order for soft copy images 
to be accepted by the medical community. The typical 
radiological image is different from other images in 
several ways. 

Radiological images used in medicine present 
peculiar problems for compression compared to con- 
ventional image compression problems. The images 
locally have very low contrast. For example, a transi- 
tion over an edge of a bone does not change the im- 
age intensity by a large amount. While the local vari- 
ations are small, the dynamic range over the whole 
image may be quite large. Much of the information is 
contained in the local variation of image intensity. The 
overall image provides a context within which the in- 
formation is embedded, but the pathology is visible as 
local variations. The images are subject to large 
changes in the individual pixel intensity as the radiol- 
ogist views the image. A radiologist may change the 
contrast and the center of the contrast range in his ef- 
forts to see details in the image. In the extreme, the 
radiologist may invert the image, changing white to 
black. The images are very large, typically more than 
1 k by 1 .2k pixels and up to 2k by 2.5k pixels. The im- 
age dynamic range typically requires 12 bits. The im- 
age is viewed at a number of magnifications from 2:1 
minified, to 8:1 zoomed. 

The well-known CCITT JPEG standard uses an 
8x8 discrete cosine transform in the image compres- 
sion scheme. The number of bits In the image is 8 or 
12 bits. The blocking effect of the discrete cosine 
transform is unacceptable as an artifact over the en- 
tire image. The dynamic range of 12 bits cannot be 
squeezed into 8 bits. If a typical JPEG compressed 
Image is examined in detail, the blocking of the 8x8 
discrete cosine transform is visible over the whole of 
the image. The details of the image are visible 
through the blocking, but the distraction of the block- 
ing over the whole of the image is unacceptable. The 
radiologist often looks at a zoomed image with con- 
trast arranged so that the blocks interfere with his 
viewing of the image. 

If radiological images were viewed in the same 
way that a TV image is viewed, the dynamic range 
could be compressed to 8 bits by a simple nonlinear 
mapping of image intensities. A typical mapping 
scheme is logarithmic mapping. With this scheme, 
displayed image intensities are proportional to the 



logarithm of the original image intensities. Since the 
image contrast and intensity center can be varied, in- 
cluding inverting the pixel values, such nonlinear 
mapping is not appropriate. No companding of the im- 
5 age intensity values is tolerable, since the compres- 
sion from 12 bits to 8 bits introduces large artifacts at 
some level of contrast or center for the displayed in- 
tensity values. 

Other techniques that are used for image com- 

10 pression are typically full image compression 
schemes. Either a Fourier transform or a cosine 
transform is used over the full image. Since the trans- 
form is a full image transform, there is no blocking of 
the image. The difficulty with the full image transform 

IS Is that the amount of computation per pixel is large 
and the images, in many cases, are constrained to be 
square images. If the images are not square, they are 
padded to make them square. In many Implementa- 
tions, the number of pixels in the image that is com- 

20 pressed is constrained to be a power of two. Again the 
images must be padded with zeros to make them a 
power of two. 

In view of the above, it is an objective of the pres- 
ent invention to provide for apparatus and methods 

25 that provide for image compression of radiological im- 
ages that suppresses artifacts present in the image 
due to blocking. 

SUMMARY OF THE INVENTION 

30 

The present invention provides for a compression 
scheme tailored to the compression of large radiolog- 
ical images displayed using image workstations. The 
present invention may be implemented as a special 

35 purpose processor for use in a computer workstation, 
for example, or may be implemented in firmware or 
software if so desired. The compression scheme is a 
variation of CCITT JPEG compression that is adapted 
to suppress blocking effects caused by the process- 

40 ing of images with discrete cosine transforms used in 
conventional JPEG compression. The compression is 
particularly useful for archiving or telecommunicating 
images, achieving compression of more than 10:1 
without losing the characteristics of the original radi- 

45 ological image. Furthermore, the apparatus and 
method of the present invention produces a com- 
pressed radiological image that permits effective di- 
agnosis. 

In order to achieve the above and other objec- 
50 tives. the present invention provides for image com- 
pression apparatus and methods for use with radi- 
ological images that suppresses artifacts present in 
the image due to blocking. The present invention re- 
duces the size of digitized radiological images for 
55 storage or for transmission such that the images re- 
main clinically useful for diagnosis. The present in- 
vention provides for the separation of low frequency 
components for suppression of compression artifacts 
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combined with a block mode transform compression 
for localizing compression noise. The present inven- 
tion suppresses block artifacts in compression while 
providing for compression noise with a controlled lo- 
cal signal-to-noise ratio. ^ 

The suppression of artifacts due to blocking is ac- 
complished by the use of a difference image The 
onginal image is downsampled. then interpolated 
back to Its original size to produce a smoothed image 
The difference between the smoothed image and the io 
ongmal image is then compressed using an 8x8 dis- 
crete cosine transform with 12 bit data. The major ar- 
tifacts present in the original image are due to the mis- 
matching of the low frequency components of the im- 
age at the edges of the blocks. Consequently, when ,5 
he ow frequencies are removed by subtracting out 
the low frequency components, the artifacts disap- 
pear except in areas having very large dynamic 
changes. 

To make the quantization noise relative to the 20 
magnitude of local variations in the image, the total 
energy in the transform block is normalized, then 
weighted, quantized, and coded. The normalization is 
accomplished by finding the sum of the squares of 
coefficients of the cosine transform. A gain factor is 25 
determined such that the energy in a block is equal 
to a constant. This gain factor is applied to each of the 
coefficients of the transform, changing the energy in 
the block to a constant value that is equal to the nor- 
malization energy. The coefficients are then quan- 30 
tized by rounding (not truncating) to the nearest inte- 
ger. An exception is made if the energy in the block 
IS larger than a predetermined threshold. In this case 
no normalization is performed. The coefficients are 
quantized at the original level. When the energy is 35 
high, the dynamic range of the image in that vicinity 
IS high, leading to more prominent blocking effects. 
When the block is not normalized, the quantization 
noise IS reduced, thus suppressing the blocking ef- 

40 

The coding of the weighted coefficient values 
may be done in several ways. The use of a Huffman 
code or an approximate Huffman code is one techni- 
que. The Huffman code uses short code words to 
transmit coefficient values that happen often and Ion- 45 
gercode words to transmit coefficient values that are 
less probable. The average code word length is small- 
er using this approach than using a fixed length code 
word. An energy normalization parameter controls 
the amount of compression accomplished by the 50 
Huffman coding. When the normalization constant is 
small, the numbers to be encoded are small. The re- 
duction of the range of numbers to be encoded reduc- 
es the number of bits required to encode the num- 
bers. 

An alternative to Huffman coding is to use arit h- " 
metic coding. This approach codes the weighted 
quantized coefficients in a code word that maps the 



coefficient values into the interval from zero to one 
The arithmetic coding scheme may be made adap- 
tive, and thus be independent of the type of image in 
contrast to the image type sensitivity of the Huffman 
coder. 

The discrete cosine transform yields a set of 
transform coefficients. The coefficients roughly de- 
scribe the energy levels at frequencies in the row and 
column directions in the image. The human eye is less 
sensitive to noise at high frequencies, thus permitting 
coarser quantization at higher frequencies The 
coarser quantization is accomplished by frequency 
weighting the transform coefficients. Lower weights 
are given to higher frequency components 
1 7!"^ compression of the image is accomplished 
by deleting the high frequency components with little 
energy and using Huffman (or other) coding on the re- 
maining quantized discrete cosine transform coeffi- 
cients to compress them. The level of quantization of 
the discrete cosine transform coefficients is adjusted 
by setting a quantization level that depends on the en- 
ergy in the block. When the block energy is high the 
quantization level is high. With such large images the 
no.se generated by the quantization is a white noise 
over the entire image. The human eye can look 
through such noise, averaging the intensity values in 
a local region to suppress the noise. Even severe 
noise only appears to be a general haziness to the im- 



BRIEF DESCRIPTION OF THE DRAWINGS 

The various features and advantages of the pres- 
ent invention may be more readily understood with 
reference to the following detailed description taken 
in conjunction with the accompanying drawings, 
wherein like reference numerals designate like struc- 
tural elements, and in which: 

Fig. 1 shows an image compression apparatus 

and method in accordance with the principles of 

the present invention; 

Fig. 2 shows how high frequency component de- 
letion IS performed in the apparatus and method 
of Fig. 1 starting at the highest frequency and pro- 
ceeding toward lower frequencies until a desired 
percent of the energy has been removed: 
Fig. 3 shows a differential pulse code modulation 
encoding method employed in the apparatus and 
method of Fig. 1; 

Fig. 4 shows an Image reconstruction apparatus 
and method in accordance with the principles of 
the present invention, which uses a minified im- 
age and a recovered difference image to recon- 
struct the original image; and 
Fig. 5 shows recovery of the downsampled image 
•n the image reconstruction apparatus and meth- 
od of Fig. 4. 
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DETAILED DESCRIPTION 

Referring to the drawing figures, the architecture 
and processing flow of an image compression appa- 
ratus and method 10 in accordance with the princi- 5 
pies of the present invention is shown in Fig. 1 More 
particularly. Fig. 1 shows the use of downsampling 
and interpolation processes that eliminate low fre- 
quency components from a discrete cosine trans- 
formed image. The suppression of artifacts in an orlg. w 
inal image 11 due to the blocking iis accomplished by 
the use of a difference image 13a. An original image 
11 IS downsampled 12 to produce a downsampled im- 
age 1 2a. which is then Interpolated 14 back to the size 
of the original image 11. Interpolating the down- 15 
sampled image 12a produces a smoothed image 14a. 
The difference image 13a is produced between the 
onginal image 11 and the interpolated image 14a us- 
ing an adder 13. The difference between the smooth- 
ed image 14a and the original image 11 is then com- 20 
pressed 15 using an 8x8 pixel block discrete cosine 
transform with 12 bit data. This produces a trans- 
formed image 1 5a. Major artifacts that are present in 
the original image 11 are due to the mismatching of 
low frequency components in the original image 11 at 25 
the edges of the blocks. When the low frequencies 
are removed and separately coded 20a by subtracting 
out the low frequency components to produce a cod- 
ed difference image 22, the artifacts disappear ex- 
. cept in areas of very large dynamic changes. 30 

To make quantization noise present in the differ- 
ence image 13a relative to the magnitude of local va- 
riations, the total energy in the transform block (trans- 
formed image 15a) produced by compression is nor- 
malized 16. and is then weighted 17. quantized 18. 35 
and encoded by the coder 20a. The normalization 16 
IS accomplished by finding the sum of the squares of 
the coefficients of the discrete cosine transform. A 
gam value such that the block energy is equal to a 
constant is determined. This gain value is applied to 40 
each of the coefficients of the transform, changing 
the energy in the block to a constant value equal to 
the normalization energy. The coefficients are then 
quantized 1 7 by rounding (not truncating) them to the 
nearest integer. An exception is made if the energy in 45 
the block is larger than a predetermined threshold. In 
this case, no normalization 16 is performed, and the 
coefficients are quantized 17 at the original level. 
When the energy is high, the dynamic range of the im- 
age in that vicinity is high, leading to more prominent so 
blocking effects. When the block is not normalized 
16. the quantization noise is reduced, suppressing 
the blocking effects. The above processing produces 
the coded difference image 22 that is a first part of a 
compressed image file 1 1 a. 55 

The downsampled image 12a is differential pulse 
code modulated 19 and is also encoded in a second 
coder 20b using the same coding scheme as is used 



for the quantized, weighted transform coefficients 
This produces a coded downsampled image that 
forms a second part of the compressed image file 
11a. 

The encoding 20a of the weighted coefficients 
may be done in several ways. The use of a Huffman 
code or an approximate Huffman code is a technique 
to code the weighted coefficients. The well-known 
Huffman code uses short code words to transmit 
coefficients that happen often and longer code words 
to transmit coefficients that are less probable The 
average code word length is smaller using this ap- 
proach than using a fixed length code word. An ener- 
gy normalization parameter controls the amount of 
compression 15 accomplished by the Huffman cod- 
ing. When the normalization constant is small, the 
numbers to be encoded are small. The reduction of 
the range of numbers to be encoded reduces the 
number of bits required to encode the numbers. 

An alternative to the use of Huffman coding is the 
use of arithmetic coding. This approach codes the 
weighted, quantized coefficients in a code word that 
maps the coefficients into an interval from zero to 
one. This scheme may be made adaptive, and is thus 
independent of the type of image in contrast to the im- 
age type sensitivity of the Huffman coder. 

The discrete cosine transform compression 15 
produces a set of transform coefficients. The coeffi- 
cients roughly describe the energy levels at frequen- 
cies in the row and column directions of pixels in the 
original image 11. The human eye is less sensitive to 
noise at high frequencies, permitting coarser quanti- 
zation 17 at the higher frequencies. The coarser 
quantization 1 7 is accomplished by frequency weight- 
ing the transform coefficients. Lower weights are giv- 
en to the higher frequency components. 

. The compression achieved by the present inven- 
tlon is accomplished in two ways, the deletion of the 
high frequency components with little energy and the 
use of Huffman coding, for example, on the remaining 
quantized discrete cosine transform coefficients. The 
level of quantization 17 of the discrete cosine trans- 
form coefficients is adjusted by setting a quantization 
level that depends on the energy In the block. When 
the block energy is high, the quantization level is high. 
With such large images the noise generated by the 
quantization 17 is a white noise over the entire origi- 
nal image 11. The eye looks through such noise, aver- 
aging the intensity values in a local region to sup- 
press the noise. Even severe noise appears to be 
only a general haziness to the image. 

On the other hand the deletion of the high fre- 
quency components of the original image 11 tends to 
make the image 11 less crisp. Carried to an extreme, 
essential detail begins to disappear from the image 
11. If the energy were uniformly distributed over the 
discrete cosine transform coefficients, the deletion of 
one coefficient removes about 1.6% of the energy. 
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Ninety percent of the energy would be contained in 57 
of 64 coefficients. The energy is not uniformly distrib- 
uted and is contained mostly in the low frequency 
components. Typically 45 coefficients remain when 
the energy retained is 95% of the original energy and s 
1 2 coefficients are retained when the energy retained 
is 50% of the energy. 

The implementation of the elements of the com- 
pression scheme of the present invention are impor- 
tant to successful suppression of the blocking. In par- io 
ticular the filtering used in downsampling 12 and in- 
terpolation 1 4 back to the original image size must be 
done carefully in order to remove a large part of the 
low frequency energy of the original image 11 and to 
form a seamless connection across the blocks. A suit- f 5 
able filter is a raised cosine or a Kaiser window with 
a span of 9 pixels. The same filter is used for down- 
sampling 12 and for interpolation 14 to restore the 
ongmal image size. The span of 9 pixels means that 
for these two filter types, the weighting for the pixel 20 
that IS separated from the center of the filter by four 
pixels IS zero. The result is that the filter actually re- 
quires seven multiply-adds to form a point in the 
downsampled image 14a. 

The downsampling 1 2 is performed in two steps 25 
downsampling in the row dimension followed by 
downsampling in the column direction of the image 
11. While a composite filter that performs the com- 
plete downsample operation in one step could be per- 
formed, the number of multiply-adds required is 30 
greater than the one dimension at a time approach 

The interpolation 14 is performed in the row and 
column direction simultaneously. The interpolation 14 
may be viewed as inserting pixels in the downsam- 
pled image 12a by adding pixels with zero value fol- 35 
lowed by a filtering operation. The filter is the above- 
described two dimensional raised cosine or Kaiser 
window. The actual number of multply-adds required 
to build the image is limited, since most of the pixel 
values are zero. For some of the pixels no multiply 40 
adds are required, since there is only one non-zero 
pixel and the weightfor that pixel is one. Forotherpix- 
els two multiply-adds are required, while for yet oth- 
ers, four multiply adds are required. The organization 
of the sequence of multiply-adds so that only the re- 45 
quired computations are performed makes for fast 
operation. 

Normalization 16 proceeds by forming the 
square-root of the sum-of-squares of the discrete co- 
sine transform coefficients. A multiplier that normal- 50 
izes the energy of the block of discrete cosine trans- 
form coefficients is found by dividing the normalized 
energy constant, a parameter of the compression by 
the energy in the block. Each of the coefficient values 
is multiplied by the resulting value. 55 

An exception is made if the energy in the block is 
larger than a predetermined threshold value, as is in- 
dicated by the bypass path around the normalization 



step 16a and through a threshold determination step 
21 to the weighting step 16. This large value of the en- 
ergy in a block of the difference image 13a indicates 
that there is an area with high dynamic range within 
the block. This high dynamic range shows the effects 
of the quantization and the blocking more prominently 
than does the surrounding lower energy blocks In 
these areas no normalization is performed, as is in- 
dicated by the bypass path through the threshold de- 
termination step 21. The discrete cosine transform 
coefficients are quantized 18 by rounding to form In- 
tegers without modifying the amplitude of the coeffi- 
cients. 

The frequency weighting 16 is performed after 
normalization 17 and before quantization 18 of the 
coefficients. The frequency weight is. for example, a 
simple exponential weighting function: W(row col- 
umn) = eH««^um„,/e,. where W is the weight, row is 
the number of the row In the block from 0 to 7. column 
IS the number of the column within the block from 0 
to 7. and c is the weighting parameter. After the fre- 
quency weighting 16. the discrete cosine transform 
coefficients are quantized 18 by rounding them to 
form integers as was discussed above. 

With reference to Fig. 2. the high frequency val- 
ues are removed by deleting the high frequency com- 
ponents in order (illustrated by the arrowed line) until 
a percentage of the energy in the block has been re- 
moved. The percentage of the energy that is retained 
IS a parameter of the compression. By including the 
number of coefficient values that have been retained 
in the coded block information, the level of deletion is 
retained. 

Referring to Fig. 4. on reconstruction, the coded 
downsampled image 23 is reconstructed by decoding 
the Huffman (or other) code and inverting the differ- 
ential pulse code modulation process 18. The down- 
sampled image 23 is interpolated back to the full im- 
age size in the same manner as used in the compres- 
sion process. The interpolated image is ready to be 
added to the difference image as soon as it is recon- 
structed. 

The reconstruction of the coded difference image 
22 to produce a recovered difference image 26a is 
performed by decoding the Huffman (or other) code 
recovering the weighted, normalized discrete cosine 
transform coefficients. The weighting and normaliza- 
tion are removed 24 by multiplying by the reciprocal 
of the weights used in during compression, and by 
multiplying each coefficient by the ratio between the 
normalization energy and the energy in the block 
The energy in the block is part of the coded informa- 
tion with the coefficients. The normalization energy 
IS a parameter of the compression and is passed with 
the compressed image to permit decompression. 

The difference image is recovered by performing 
an inverse discrete cosine transform 26 on the cosine 
transform coefficients. The original image 1 1 is recov- 
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ered by adding the recovered difference imaae 26a tn 
a recovered interpolated downsampied image 29a ° 

steps. The expansion architecture and processino 
steps are shown in Fig. 4. The minified In^age^S 

coeff .cents using the block energy value recorded^ 
a second word of a compressed block. The inve^e ,5 

suiting ,n the recovered difference image 26a The 
m™f,ed ,mage (coded downsampled image 23} is 
hen,nterpolated 29 back to full Size and added to he 

cover the approximation to the original imaqe 1 1 fre- 
constructed original image 11b) ^ 

ing28'of?j[I';«H'Hr''" P^^^ess- 
ng 28 of the coded downsampled image 23 is shown 

nmo^detai.inFig.5.Thesimp,icityoft 
lal pulse code modulation encoder is maintained 

lat on decoder 28. The result of using the differential 
pulse code modulation decoder 28 is the recover^ 

Sand addln '"^^'P^'^'^'^ •"'age 

f£Z ° '° "'^ difference image 

26a derived from the cosine transform processing 26 
The use of the compression scheme of the pre!: 
ent invention results in a noise value that is the S « 

thr^stl, " ""'^^ ■'"^ °f energy 
threshold frequency cutoff and the energy normalii^ 
t.on level establish the noise level relath^e to The ,^ 
age energy level. Since the low frequencies are r^ 
'"J'' r '■"'^ae 23. tS ene gy att 
rZ ?? energy Of the high frequences This 

r^n? ""^f^Pressron local. That is. the compres- 

area, but on the changes in intensity over a small 
area^Considering the noise to be the d'epar Jre f^ 

ranbTrT;'?'' '''' ^'9nai.tLo,se Z 
can be calculated, and is given by 

^''a s^^nd ' P"'P<^«°"-energy_deleted) ,0 

is th« „r ? '°"'P°"«"* °f ^f^e signal-to-noise ratio 

estaWishfd " «'"^"««tion level is 

established with reference to the energy level of the 

taSns^ld?"'"?''"" '=°"'P°"«"« be es! 
tablished by analysis, and wherein 

whiJrS^i^ f'^, * ^ logCNormalization level). 
Tnerl^c '«^el that the signa 

energy .s raised to before the quantization 18 is per 
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^^r^igirn^^^^^^^^^^^^ 

rn^; ene"rgr " '"'^'^ °' 
si«„ °^ '''^ ^^'^^''"9 coefficient on compres- 

f icieZL' °' ' ^^'^'P'^'^^' --9^«ng coX 

vZIl J '''^"''°"''"*'''^«^'°^estoretheori^ 
v^ues to he image 11. it is possible for the values 0 

in tnis case, the high frequencies are accented on 
compression, reducing the amount of compression 
and .n,.eas.ng the quality of the compressed' ma^e • 
the I'^V T'"''"^'' "^as two segments 

ifecrTfcSirr ^""^^'^^^'^ -^^<^ ^n "^e 
discrete cosine transform compressed coded differ 

ence irj^age 22. The format of the file of t^eTom 

a7e7usrcV'"'''^'=°"^^^^-«-°°^-^^^^^ 
the late '"'^e image. Each block of 

the large image consists of a 6 bit word indicatina th^ 
number of coefficients retained, a word ind ca no he 

S!ff >• ? '^'"^'"'"9 ^'■^'^«*e cosine transform 
the aslT ^'l' <=°<^ed to support 

eade ther^:' ' e compression. In the image' ile 
neader there must be an indication of the level of the 
nornialization of the image block energy 

The small image is encoded using a simple differ- 
ential pulse code modulation scheme showntFto S 

ed using the Huffman encoder. The use of the some 
hing more than the very simple encoding « not lar- 

the T"'^ ""^ge. The use of 

he Huffman coder reduces the number of bits by a 
factor Of approximately 2.5 depending on the mage 

Tfactorof an' r °' '"'^^^^"'^^ '"^^9e 13a by 
a factor of 40:1 results in an overall compression ratio ■ 

vlrv li* . ^'"'''^ "^"^ compression ratio with 
dJ erln? ^"rther compression of the 

d-fference image 13a results in unacceptable degra- 

th si ;jr°" '° f-'^er reduce 

the size of the compressed small image. However 

ato^T^T''" 23 may be 

accomplished by applying minification along with dis 
c^Bte c transform compression of the different ■ 
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The perceived image quality provided by the 
present invention is very good. The compression from 
12 bits per pixel to about 1.2 bits per pixel leave an im- 
age that is very difficult to discriminate from the orig- 
fnal image 11. Beyond this factor of 10:1 compression 5 
hJ image begins to degrade slightiy. At 15:1 conr. 
pression. h^h contrast areas of the image begin to 
show the blocking of the discrete cosine transform. At 
20-1 compression sharp edges of the image are no- 
ticeably softer due to the loss of the high frequences. . lO 

There are three compression parameters, the en- 
ergy normalization constant, the percent energy re- 
tained, and the frequency weighting coefficient. The 
energy normalization constant is a number between 
5 and 5000. The percent energy retained is a number ts 

between 1 and 100. The frequency weighting coeffi- 
cient is a number between 2 and 10. The compression 
may be controlled using a single number between 1 
and 100. The compression control number can be 
mapped into the three compression parameters using 20 
a suitable function to establish the quality of compres- 

^'°"The amount of compression is variable. If there is 
much detail in the image, the compressed image is 
longer than an image with little detail. 

Thus there has been described a new and im- 
proved image compression apparatus and methods, 
for use in compressing and reconstructing radiologi- 
cal images. It is to be understood that the above- 
described embodiment is merely illustrative of some 30 
of the many specific embodiments which represent 
applications of the principles of the present invention. 
Clearly, numerous and other arrangements can be 
readily devised by those skilled in the art without de- 
parting from the scope of the invention. 
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Claims 

1. An image compression method (10) character- 

ized by the steps of. ,1 
downsampling (12) an original radiological 
image (11) to produce a downsampled image 

interpolating (14) the downsampled image 4S 
(12a) back to its original size to provkle a smooth- 
ed image (14a); 

processing (13) the smoothed image 
(14a) and the original image (11) to provide a dif- 
ference image (13a); 

processing (15) the difference .mage 
(1 3a) using a discrete cosine transform to provide 
a transformed difference image (1 5a); 

frequency weighting (1 7) the transformed 
difference image (1 5a) to provide a weighted dif- ss 

ference image; 

quantizing (18) the weighted difference 
image to provide a quantized difference image; 



encoding (20a) the quantized difference 
image to produce an encoded difference image 
(22); 

differential pulse code modulating (1 9) the 
downsampled image to produce a differential 
pulse code modulated downsampled image; and 

encoding (20b) the differential pulse code 
modulated downsampled image to produce a 
coded downsampled image (23); 

whereby the encoded difference image 
and the encoded downsampled image comprise 
a compressed image, and wherein the compres- 
sion is adapted to remove artifacts present in the 
original radiological image caused by blocking. 

The method (10) of Claim 1 further comprising 
the step of normalizing (16) the compressed im- 
age prior to the frequency weightng (17). charac- 
terized by the steps of: 

finding the sum of the squares of the coef- 
ficients of the discrete cosine transform; 

determining a gain factor such that energy 
in the transformed difference image is equal to a 

constant and 

applying the gain factor to each of the 
coefficients of the discrete cosine transform, 
changing the energy in the transformed differ- 
ence image to a constant value that is equal to 
the normalization energy. 

3 The method (10) of Claim 1 wherein the step of 
quantizing (1 8) the compressed image is charac- 
terized by the step of rounding coefficients to 
quantize them to a nearest integer. 

4 The method (10) of Claim 1 wherein, if the energy 
the transformed difference image is larger that a 
predetermined threshold, the step of quantizing 
(1 8) the compressed image comprises quantizing 
the coefficients at their original level so that the 
quantization noise is reduced, thus suppressing 
blocking effects. 

5 The method (10) of Claim 1 wherein the step of 
encoding (20a) the quantized image is character- 
ized by the step of encoding of the weighted coef- 
ficient values using a Huffman code. 

6 The method (10) of Claim 1 wherein the step of 
encoding (20a) the quantized image is character- 
ized by the step of encoding of the weighted coef- 
ficient values using an arithmetic code that codes 
the weighted, quantized coefficients in a code 
word that maps coefficient values into an interval 
from zero to one. 

7 The method (10) of Claim 1 wherein the step of 
processing the difference image (13a) using a 
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discrete cosine transform is characterized by the 
step of frequency weighting the transform coeffi- 
cients wherein lower weights are given to higher 
frequency components. 

8. The method (10) of Claim 1 Wherein the step Of ' 

tl'S!^?^.;"^ ''""'""^ '"^^^ <13a) is charac- 
terized by the steps of: 

deleting high frequency components hav- 
ing little energy; and 

Huffman coding the remaining quantized 
discrete cosine transform coefficients. 

9. The method (10) of Claim 8 wherein the level of 
quantization of the discrete cosine transform 
Z ?hT ^""'"9 ^ quantization 

formed difference image. 



/5 



10. Animagereconstructionmethod(10)forusewith 20 
compressed images comprising an encoded dif- 
ference radiological image and an encoded 
downsampled radiological image that produces a 
reconstructed image, said method (10) charac- 
terized by the steps of: 

decoding (24) the encoded difference im- 
age (22) to produce a decoded image (24a)- 

frequency weighting and removing' the 
normalization of the decoded difference image 
(25) to produce a restored transformed difference 30 
image; 

transforming (26) the restored trans- 
formed difference image using an inveree dis- 
crete cosine transform to produce a restored dif- 
ference image (26a); 

.<lecoding (27) the coded downsampled ra- 
agt'^Za) ''"^^^ (23) to produce a decoded im- 

differential pulse code demodulating (28) 
he decoded image (27a) to produce a demodu- 4o 
fated image (28a); 

interpolating (29) the differential pulse 
code modulated image (28a) to provide a full 
scale smoothed image (29a); and 

adding (30) the compressed image (26a) 45 
and the smoothed image (29a) to produce a re- 
constructed original image (lib). 
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11. Image compression apparatus (10) characterized 
by: 

means for downsampling (12) an original 
radiological image to produce a downsampled im- 
age; 

"leans for interpolating (14) the downsam- 
pled image back to its original size to provide a 55 
smoothed image; =030 

means for processing (1 3) the smoothed 
•mage and the original image to provide a differ- 

8 



ence image; 

means for processing (15) the difference 
-mage using a discrete cosine transform to pro- 
vide a transformed difference image; 

means for frequency weighting (17) the 
transformed difference image to provide a 
weighted difference image; 

means for quantizing (18) the weighted 
difference image to provide a quantized differ- 
ence image; 

rtw-™'"^^"® (20a) the quantized 

difference image to produce an encoded differ- 
ence image; 

inn MQwf? P"'se code modulat- 
ng (19) the downsampled image to produce a dif- 

IgTand""'^ "^"^^ modulated downsampled im- 

n.,ic. ""T^ (20b) the differential 

pulse code modulated downsampled image to 
produce a coded downsampled image- 
.nH .J*'^'^*'^ encoded difference image 
and the encoded downsampled image comprise 
a compressed image, and wherein the compres- 
S|on IS adapted to remove artifacts present in the 
onginal radiological image caused by blocking. 

12. Theapparatus(10)ofClaim11further Character- 
ized by means for normalizing (16) the com- 
pressed image is characterized by: 

means for finding the sum of the squares 
forin °' discrete cosine trans- 

means for determining a gain factor such 
that energy in the transformed difference image 
IS equal to a constant; and 

means for applying the gain factor to each 
of the coefficients of the discrete cosine trans- 
form, changing the energy in the transformed dif- 
ference image to a constant value that is equal to 
the normalization energy. 

13. The apparatus (10) of Claim 11 wherein the 
means for quantizing (18) the compressed image 
•s characterized by means for rounding coeffi- 
cients to quantize them to a nearest integer. 

14. The apparatus (10)of Claim 11 wherein, if the en- 
ergy in the transformed difference image block is 
argerthat a predetermined threshold, the means 
for quantizing (18) the compressed image is char- 
acterized by means for quantizing (18) the coef- 
ficients at their original level so that the quanti- 
zation noise is reduced, thus suppressing block- 
ing effects. 



15. The apparatus (10) of Claim 11 wherein the 
means for encoding (20a) the quantized image is 
Characterized by means for encoding of the 
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weighted coefficient values using a Huffman 
code. 

16. The apparatus (10) of Claim 11 wherein the 
means for encoding (20a) the quantized image is 5 
characterized by means for encoding of the 
weighted coefficient values using an arithmetic 
code that codes the weighted, quantized coeffi- 
cients in a code word that maps coefficient val- 
ues into an interval from zero to one. w 

17. The apparatus (10) of Claim 11 wherein the 
means for processing (15) the difference image 
using a discrete cosine transform is character- 

ized by means for frequency weighting (17) the is 
transform coefficients wherein lower weights are 
given to higher frequency components. 

18. The apparatus (10) of Claim 11 wherein the 
means for processing (15) the difference image 20 
is characterized by: 

means for deleting high frequency compo- 
nents having little energy; and 

means for Huffman coding the remaining 
quantized discrete cosine transform coefficients. 25 

19. The apparatus (10) of Claim 1 8 wherein the level 
of quantization of the discrete cosine transform 
coefficients is adjusted by setting a quantization 
level that is a function of the energy in the trans- 30 
formed difference image. 



35 



40 



45 



50 



55 



^ZiO: <EP aS77363Al J.> 



EP 0 577 363 A1 




\ 



03 



10 




EP 0 577 363 A1 



COLUMN NUMBER 
0 1 2 3 4 5 6 7 

0 
1 
2 

ROW 3 
NUMBER 

4 

5 
6 
7 

Fig. 2 




DOWNSAMPLED 
IMAGE 




DIFFERENCE 
IMAGE 



CODED 







CODER 


IMAGE 









32 



19a 



19 



20 



Fig. 3 



11 



OCID: <EP 0577363A1 J,> 



EP 0 577 363 A1 



CODED 

DIFFERENCE 
IMAGE 



24a 



DECODER 



V 



24 




FREQUENCY 
WEIGHTS 
RESTORE 
NORMALIZATION 



23 



INVERSE 
BLOCK 
DISCRETE 
COSINE 
TRANSFORM 

~7 

26 



RECONSTRUCTED 
IMAGE 



V 



DECODER 


27a 


DIFFERENTIAL 
PULSE CODE 
DEMODUUVTION 




\ 



IMAGE 



27 



28 




Fig. 4 



CODED 
DOWNSAMPLED 



26 



34 



- / J 


[DECODER 




23^ 




27 


27a 




Fig. 5 



23a 

1 



r „ 1 


1 




ONE PIXEL DELAY 


1 



35 



12 



EP 0 577 363 A1 



£urope«n Patent 
Office 



EUROPEAN SEARCH REPORT 



EP 93 30 5022 



DOCUMENTS CONSIDERE D TO BE RELEVANT 



Ckadoo of d» 



It wicb imliiirinni wterv ftppro^riatB, 



Rekvast 



US-A-4 665 436 (OSBORNE ET AL.) 

* column 4, line 44 - column 7, line 27; 
figure 1 * 

IEEE TRANSACTIONS ON COMMUNICATIONS 
vol. 37. no. 4, April 1989, NEW YORK US 
pages 380 - 386 ^ , * 

NG ET AL. 'Two-Tier DPCM Codec for 
Videoconferencing' , . ,0, 

* page 380, column 1, line 21 - page 381. 
column 1. line 37; figure 1 " 

lEICE TRANSACTIONS ON COMMUNICATIONS 
vol. E75-B, no. 5, May 1992. TOKYO JP 
pages 340 - 348 

ALGAZI ET AL. 'Perceptually Transparent 
Coding of Still Images' - 

* page 340, column 2, line 14 - page 341. 
column 2, line 18; figure 1 " 

* page 342, column 2, line 1 - page i**. 
column 2, line 9; figure 2 « 

SYSTEMS & COMPUTERS IN JAPAN 
vol. 22, no. 2. 1991. NEW YORK US 

GOTOH ET AL. 'A Compression Algorithm for 
Medical Images and a Display with the 
Decoding Function' 

* page 86, column 1. line 5 - page 8». 
column 1. line 21; figures 1,2 



I, 5.10, 

II. 15 



CLASsmcA-noN of the 



H04N7/13 
H04N7/133 



I, 5.10, 

II, 15 



I, 5,10, 

II, 15 



1.10,11 



TECHNICAL FIELDS 
SEARCHED (lBt» CLS ) 



H04N 



BERLIN 



itpoct has been drmmi op for ai 



16 AUGUST 1993 



MATERNE A. 



CATEGORY Of CITED DOCUMEMS 



Y . BinlcuUitT fcl«vint tf takes iloM 
Y : QtftloBUriy NiMSt If coaMB«i wltk 
aocufliat of th« — 



E • eaHi« p»t«t tocuaiftti Dirt poUlsftM oot or 

D ' docaa«t dtai la tk* apptteadoa 
L : docnast dt«4 for odMr nssoos 




•0 <6P 0577363A1J_> 



433a Electronics Communications in Japan 
73(1990)June. No. 6, Part I, New York, US 



llllllli 

XP 0001707<*<» 



Electronics and Connounicacions in Japan, Pare 1, Vol. 73 No 6 1990 

Translated fro» Denshi Joho Tsushin Cakkal Ronbunshi, Vol. 72-B-I, No. U. AprU 1989. pp. 377-384. 



r 



Improvement of Picture Quality and Coding Efficiency 
Using Discrete Cosine Transform 

Yuuji Izawa and Masaaki Takizawa, Members 
Central Research Laboratory, Hitachi, Ltd., Kokubunji, Japan 185 



SUMMARY 

In the applications of still picture 
coding such as image data base, the progres- 
sive coding is effective in reducing the 
retrieval time and the transmission cost. 
For the block coding based on the discrete- 
cosine transform (DCT) , a study has been 
made on the progressive and successive trans- 
mission from dc to higher-order ac compo- 
nents. In this scheme, the major cause of 
the picture quality degradation is the block 
distortion produced at the initial stage. 

This paper proposes two methods to re- 
duce the block distortion where the lower- 
order ac coefficients are determined from 
the dc coefficients transmitted at the first 
stage and applied the inverse-DCT. The first 
method is to determine the lower-order ac 
coefficients so that pixel values are smooth- 
ly connected at some points on the block 
boundary. The second method is based on the 
application of the interpolation filter uti- 
lizing the property of DCT. Furthermore, it 
is shown that by transmitting the difference 
between the DCT coefficients to be transmit- 
ted and the coefficients generated by the 
proposed method, the coding efficiency can 
be improved by 5 to 8 percent. 



1 . Introduction 

In picture coding for low bit rate, 
a high compression ratio is achieved by 
transform coding. The orthogonal transform 
is a method which transforms the picture sig- 
nal into a sort of two-dimensional (2-D) 
frequency component. Among such methods. 
DCT (discrete-cosine transform) [I - A] is 
used extensively. 

On the other hand, in the still-picture 
transmission, assuming the applications .such 
as image database, the progressive coding 
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[5, 6] is considered useful, from the view- 
point of reducing the retrieval time, trans- 
mission cost and the psychological load. 

A study has been made which combines 
those methods to transmit and display suc- 
cessively, from dc coefficiencs to' the 
higher-order ac coefficients. However, chis 
method has a problem in that the block 
distortion is produced at the initial stage 
The 2-D filtering can be applied co eliininate 
the block distortion. However, ic causes a 
large computational complexity and a special 
hardware is required, for the real-time pro- 
cessing. 

This paper proposes two methods to re- 
duce the block distortion by a small amount 
of calculation. Those methods detenr.ine the 
lower-order ac coefficients from dc coeffi- 
cients transmitted at the first stage and 
then applied the inverse-DCT [7, 8]. Fur- 
thermore, the average separating block cod- 
ing [9] is applied to the proposed method. 
By simulation, the improvement of the coding 
efficiency is examined and the computational 
complexities are compared. 

2. Block Coding by DCT 

This section describes the f undan^.encal 
properties of the DCT. 



2.1 Definition of DCT 

The «-th order normalized DCT matrix 
(i ^ J) is given as follows: 

(/./=1,2. n) 

where ki^ll J2 for £ = I 
= 1 for 2*1. 

ISSN8756-6621 /9n/nnnA_orn 



(1) 



-i- indicates the spatia"- f^^« 

denotes the V^.J.T.^V^^^Z7 lu"""^ ' 
tlon in Che block- fT ^^^^^^^^S the posi- 

iock. [T^^.j ^3 ^ unitary matrix. 

Letting the original i^^ge be fC. .J ^nd 
the transform coefficient be [C. J ^h 
transform and the inverse t«„=^*' ' * 
fined as follows: transform are de.- 



[Cu]=[TaHG<A-'[T<j] 
[C^/]=(r„]-'.[Co]-{'[n]}-' 

2.2 Fundamental properties of DCT 



(2) 



(3) 




proced^\°^V^„L^^^1L^^.''^^«/<'^^o«i„g 

and^;: d\^-^%- S oriUal--, - 

applied. In the orf '""f « 

sajapled by a fi„L» "^^S^'^l i-^^ge is 
the same tl^e the .r""" °' i«>P"lses. At 

tacitly assl'^d ''Th1n'%h'e""'''='^^ 
equal to a lino . * ^ spectrum is 

Placed bVa SurLTs^^^ 

a ^ rourier series expression. 

functiVc'^^rii;^- -^bi-ary ™ 
°f 2-D cosine functlo" t ="P«'^P<'sition 

in^comp f;^%\^^gl3"e\^L^^^^^^^^^^ 

-Tw^!o^-e^ 



Fig. 1. Images correspond to DCT coef- 
ficients. 



the Wr- rde. DCT^If I • 

vtaer ucr coeffxcients C. Qsina 

the forementioned prooertv • 

This method has the following features. 

"ea/Jil2r'"\n'idir"}'" °^ 'he 

tealizedT ^^eal interpolation can be 



is truncat'ed'by^ii^^iJf,^""!- response 
Window and some^ e%r^\^"a%e'X"ced.^'"^ ^ 

(3) The product-sum ODera^■fr.« • 
ScTjix-e^L^e^l operator 

tion to the square of ^? ^" P-^^Po^- 

Such a convolution can 
a product form i„ ehe Fourier crL'f 
domaxn. Consequently chlrf • 
ity that the computation^? '^ ^ P°ssibil- 

-^-elf^c^^n-^^^^^^^^^ 

-3 idea is dL-uss^^ ^l^^^^^ 

the io:e\^^.^^%^"r:f,%%f .-^j--t 

-ted. Then bj the'Lv"rs"\"c1 '^tH 

distortion is eliminated tk ' 

Shown as follows °'*'='^°<1 is 

3.1 Manipulation of coefficients 
When the inverse nrr -t^ 

coefficients and Tu'too" "e'co'ef f ' '° 

the pixel value in thrb^ck can k 

sented by a superposition of H 1 
surfaces corresponding ro ^^ 
These surfaces are c^nr, coefficients. 
Fig. 1. Wh" values of '^r:; ^ f ^» 
i« the block (they need nlr " P''"'^' 

on the pixel) are give^ not necessarily be 
coefficients can bl d^t^^^ned 
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( a ) Connection points 

on block boundary (b) Average of blocks 



thod. 



Fig. 2. Four-points connection me 



The procedure to 
cients smoothly connecting at the block 
boundary is as follows . 

The values at the connecting points 

blocks . 

(2) The inverse DOT is applied to « 
unknoin' coefficients and 

flcient. and che values on the blocic bouna 
ary are calculated. Then, the values deter- 
mined in (1) are substituted. 

(3) The equations obtained in (2) are 
solved to determine the values of unknown 
coefficients. 

It is reasonable to define the points 
on the block boundary at the -^"^ °^ 

on four edges. By calculating beforehand 
the operations of (2) and (3) (or those 
ooints the computational complexity can sub 
stantlllS be reduced. The calculation exam- 
ples for four and eight unknown coefficients 
(connections) are shown in the following. 

3,2 Four-point connection 

By applying the inverse DCT " the^ 
known dc coefficient C^^ and four coeffi 

cients C^^, C^y C^y ^31 
component, the following expression is 

obtained : 

Do=lC>.+y2-G,-cos((2;-l)'r/2«) 
+ V2-C.rcosl2(2;-l);r/2«} 
+V2-a.-cos{(2i-l)'r/2n} 
+ y2-C,.-cos(2(2.-l)?r/2n}]/n 

(z.;=1.2.-.n) 




( a ) Original image 




(b) Interpolated image 



Fig. 3. Interpolated iroage by four- 
points connection method. 



A ■; =.t-p assumed as integers. How- 
tV:, 0.^ cal br considered as a superposi- 
tion of^'cosine surfaces which are continuous 
in regard to i and j. Then, using real num- 
in rega^^ at an arbitrary 

:ri:t\rthl-bJo:k can be represented. 

Consider, for example, the case^of « " 
8. and assume that four P°i"" 
the block boundary as in Fig. 2(a). The 

, An D D„ and Oo are given as fol- 
values U^, fjjj B 

lows : 



D.=tC..4-y5-C.+ y2.C.a-V2.C,. 8 
C = Cu-^-C«+V2-C«-72-C3.]/8 

o..[c...V2-a.-V2.c..4-c.]/8 



(5) 

(6) 
(7) 
(8) 



Using the averages Aq. 4^. ^ A^. and 
A of adjacent blocks as shown in Fig. 2(b) . 
Chey can be represented as follows: 



where 



£),=[Al+A1/2 

£),=[A)+A«}/2 
/\,=C../8 



(9) 
(10) 
(U) 
(12) 



(13) 
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Elifflinacing D n n 
^hose expressions '[j', ff ''^ f'^o- 
be obtained!^* ^''^i'^'ing equations 



(14) 
(15) 

(16) 
(17) 



Applying the inverse DCT . . "^"^ 
^^"ents and dc coeffSenI '^"^ 
connection is • ^i' ^ smooth 



obtained: following solution is 




(18) 



(19) 



[ f • ° ■ -VA i/A 0 

r^2.-I. 1/2 . V2 ' , ' 

_ 0 , 0,-1^ 

v^. -72] ' (20) 

-^in, 0. 

i . 0. 
■-1/2 . 0. 

iin. 0. 

-1/2. -1, 
0 . -1. -I 

<=an be'"dein^teef b'v^'n'^^ """"'^^'^y value 5 
^verage values It the ad/ °f tfe 

f«verse DCT circuit eouldT"' ''^°'^ks. xh^ 
• those matrix manioulfr^ employed in 

Sfme as in Fig. 3fan is the 

^ith the case^of foui' ^°"P«ing the result 

« four corners of the bloefc "^"^"^d 
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4.i Interpolation filter 

In the following, a method is described 
which derives the interpolated image [Q , .] 
o£ N X If pixels froin the original image^"^ 
• [Oij] of n X n pixels. As already discussed, 
the coefficient [C^^.] (i. j = 1 , 2, . . . , n) 
corresponds to a continuous surface with a 
particular spatial frequency component. In 
other words, this surface can be regarded as 
an interpolated image, and the value at an 
arbitrary point on the surface can be calcu- 
lated from [C. 

Assuming that the interpolation is per- 
formed by discrete processing, the inter- 
polated image [Q^^] (i, j = 1 . 2, . . . , iV) is 
represented as follows: 

[0.7] = 1//o]-(C.v]-[//o] (21) 

[fi^j] is an n X yv matrix with the following 
expression: 



0 = 1. 2.-. w)0 = l.2.-,iV) 
where Ki^l/Jl for i = 1 



(22) 



» 1 for i ?S 1, 



The foregoing description is divided 
into two stages: 1) to derive the DCT coef- 
ficients; and 2) the generation of the inter- 
polated image using the derived coefficients. 
However, we can combine these stages into a 
single manipulation. Using both expres- 
sions, the following relation can be derived: 



[0.7] =^'[Hu] '[Tu]' (Go] ^'[TuV [Ho] 



(23) 



where {'[^o]-[n]} and {'[T^vJ-M are {N x n) 
and in x iV) matrices, respectively. When 
the positional relation of the pixels is 
given to the original and the interpolated 
iaages, they have constant values indepen- 
dent pf the contents of these images. When 
the interpolation is not made (i\r = n) , they 
turn out to be unit matrix, and the original 
^3ge [G^j] is reproduced. 

In the definition of H^^, j is defined 
as an integer. But the sampling interval 
need not be uniform. If the interpolation 
points are arranged nonunif ormly , any real 
number can be assigned to j. Thus, the 
original image is assumed as an n x n 

square block. However, by modifying the 
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rrwi'x^^?'"^"' Interpolated image 



Fig. 6- Positional relation of inter- 
polation. 



sizes of matrices [T^^] and [H^^] to be mul- 
tiplied, a similar processing can be applied 
to the nonsquare block. 



4.2 Elimination of block distortion bv 
interpolation filter 

In the following, a method is shown 
which determines the interpolated image 
using only the block averages [4..] 

instead of the original image [G . .\ . The 

interpolated image [Q^^] is affected more 

severely by the assumption of periodicity as 
one approaches the boundary. Consequently, 
it is advantageous to set the original image 
for interpolation as large as possible. 

In practice, however, the value of N(n) 
is limited due to the limitation of the size 
of the forementioned matrices. Then it is 
advisable to perform the calculation only 
for the central part iiQ^j']) with a high 

interpolation accuracy, and to shift suc- 
cessively the central part. 

Using this method, an adequate picture 
quality can be obtained- However, in the 
interpolation processing by assuming the 
block average as the pixel value of . the 
original image, the block average of the 
interpolated image does not necessarily 
agree with the original average. This dis- 
crepancy is more remarkable near the pixels 
with the maximum and the minimum value. 

From such a viewpoint, an interpolation 
method is considered in the following, where 
the dc value (average) of the blocks is pre- 
served. Figure 6 shows the relation between 
the block average [4. -] and the image \0 1 

after interpolation processing. Assume that 
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Interpolation 
methods 

Traditional 
convolution 



No, of multi- 
plications 
^OT a block 



OCT average 
_ preserving 

*Excluding [DCTJ-i **/ x . " 

boaadary-value UculllH " ^ 



Numerical 
example 



64( + Il2)*- 



345 
example of 




^^8- 7. Interpi 



olated image by DCT 
method. 



* J « i. 2. . i^j W 

block averages "'n. T^''^^'' o£ K x k 

J , 1 2 interpolated image f^-.] 
Pi-els b«h-i^ =°»''f-'^ «) ' 



a^e'^it'''"^ ^« formed Co the 



(25) 



(26) 



(27) 
(28) 



the interpolation pro^Sr °' ""^'^^ 
detennlned. Then t^e l^v^^^' '^"''^ is 
can be calculated. f^J'^ 

Plying f;.,-lf '"^"""^^ ''^-ici- 

(3) Matrix fC. ] -fe ^ . 

r« 'I interpolated iaage 

. ^' ••••«) is calculated 

preserving the block averages. 
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(») Orisinal image (b) i-. 




pomis connection method (e) 8-points connection 



method 



(d) OCT method (4X4) (e) DCT method (S x 3i 

Fig. 8. Examples o£ incerpolaced image. 



blo.kwise!""''""' ^""^-'^ 

5^8«"^f 7 illustraCGs che foremencioned 
fI^ tr''^'" ^ f original image is 

fig. Ic can be seen chac a smooch 

cosxne surface eliminacing the block discor- 
clon is constructed. 



4.3 Comparison of computational com- 
plexity 



In the following, the computational 

^""^"^^^ interpolation method are 

compared. For simplicity, the square block 
is considered. The original image is as- 
sumed as composed of K x K pixels (or 
blocks), and the central block as composed 
ot n X n Interpolation pixels. Then the 
amount of multiplications in each interpola- 
tion method is as shown in Table 1. 

In four- and eight-point connections, 
trie computational complexity is reduced by 
one to several, compared with the tradition- 
al convolution method, even if the number of 
multiplications in the inverse DCT (32 x 8 + 
J X 8^ , 264) is considered. Similar merit 
IS observed in the method by DCT. 



5. Simulation Results 

This section shows the simulation re- 
sults for the interpolation method proposed 
m the previous section. 



5.1 Coefficient manipulation 

Figure 8(b) shows the result of the 
coefficient manipulation processing by four- 
point connection. Compared with case (a) ' 
where the block average is displayed direct- 
ly, the picture quality is improved greatly. 
Figure 8(c) shows the result of processing 
by eight-point connection. Compared with 
the four-point connection, the distortions 
at four corners are reduced. 

In the foregoing calculations, the 
boundary value B is determined using 4x4 
(comer), 4 x 3 and 3 x 4 (mid-point of 
edge) operators as shown in Figs, 9(a), (b) 
and (c), respectively, for the adjacent 
block averages. 



5.2 Interpolation filter 

Using interpolation filtering, the cen- 
tral block (8x8 pixels) was interpolated 
from the 4 X 4 and 5 X 5 peripheral block 
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to calculate the v.l„e of Mock boundary. 



Char, the coefficient Sn? T"'^" P^""" 
tained. some distorti^ 

b.ock boundary ^T/^^Vl f--d near the 

L:.t r:ere^theT:„^?"^ 

jacent blocks 1^1'^"""^ bet«^^n ad- 
^--tlon .s%ed^r:.Xle„1J.-- ^ 

tn,.rlLVZ :oe1f2i"„f ^ <^i«ortions 
f ch as the step near tJe bi"°^r''"^"'°"- 
four-potat connectL" and ttl 
near the block center in k ""^^=n"«ss 
"on, are eliminated a^moL^ '~^°'^'= """^c- 
mterpolation filter nnT '^""Pl^ely. The 
block average described •^^c^^'^^'^S ^he 
applied and^erilied '"'^ ^« ^^^o 

Picture quaUcylslbtaLed?"'" 

6- Improvement of Coding Efficiency 

"ons'reL'^;"^^^^ ^fg-"; correla- 
"^nts of the adjfceit bf^^""" "^"i" 
°atural image on t "^^' ^" "^^e 

bility is vir; lov Sat Jhf ^'^^ P^""- 

^dge at the block bound. ^ «eep 

<^3C the Pixels on boS^; 
boundary have a M»h '^^^ °^ block 
there are s^e coSf?.^°^"^"^°"- ^hus. 
lower-order^c coeJScif '""""^^ ^he 
fc con,ponent of ad"cen, bio r'"'""* 
ly. the coding effiri!" Consequent- 
"ili^ing chos^1or\\u,^L^:r ^^"^'^ 



6-1 Average separating block coding 

<lescr2:d'L'7l? 'IhiT""^."""^" "^li^e is 
P-^oves the codin.; ^J^^.^^^hod which 

coding efficiency by transmitting 
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Che difference between ^h» 
^nd the interpolated L"^""^ 
average of adjacent blocks ^T-^'^' ^he 
Polated image generated by ^he Dcl ^^%"ter- 
cxent manipulation or by the in ^ 
fUtering described in Sec J f '"P^^ation 
efficiency can be improved ^v * • "^"8 
"ion (i.e.. subtractlon^of^^ ^^"^^^ °P«c- 
coefficients. "="on) of the transform 

6.2 Mean square error 

The mean-square prm^ j 
index for evaluating thU ^ "^^"^ ^= ^" 
I" Che followinj the if, ''^J^^ efficiency, 
■n^an square of the Sf Je- ""u""^*^ ^ 
original image and the in'er 
is compared. InCerpolated images 

Table 2 shows the r^^.n r c 
measurement for a stannl^r °^ ^^^ual 
improvement of codS IffLr""'"' ^« 
percent by coefficient in ''^^ ^ ^o 6 

percent by the DCT ^nr "^"fP^^ation. and 8 

in comparx^son wiS the^e'^h:!':" 

ratio surface described in £9] °" ''"^<*- 

"ency is decreased by 1 L ? * "'^ 

coefficient «anipulatLn. Thiols"."' '""^ 
the effect of limlcin» "^"^ Co 

fona coefficient"":"! or s""^' °' 
Clonal complexity is less ^h, computa- 
compared with 1433 in rh^ ^ one-eighth 
method. " the quadratic surface 



7- Conclusions 

elimi2ij^\\^^S^^^^ 

coding based on the DC? ?h\ " T ""^"^ 
«lne the lower-order acc^I^f.'""^'''^^ 
Jc coefficients. Ind applied t'he""'' 
The two methods are as foUo^s """"^^ 
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2. Comparison of mean-square error 



j *MSE pixel 


Ratio 


Coding 
efficiency 


Block average 


190.4 


100.0% 


±0% 


4-point 
connection . 


147.1 


77.2% 


+ 5% 


o-point. 
connection 


139.1 


73.1% 


+ 6% 


Quadratic 
surface [9] 
DCT in- 
terpolation* 1 


135.9 


71.4% 


+ 7% 


128.9 


67.7% 


+ 8% 



1 — I 

SXDBA GIRL (256 x 256 pixel) , *K-4,n = 8. 



(1) The lower-order ac coefficients are 
manipulated to realize a smooth connection 
at the block boundary. 

(2) Using the interpolation filter 
based on the property of the DCT, ac coeffi- 
cients are determined so that a smooth 
cosine surface is constructed. 

By simulation, the improvement of the 
picture quality was verified. As a further ' 
application, the method to transmit the dif- 
ference between the coefficient to transmit 
and the coefficient generated from dc compo- 
nents is applied (average separation block 
coding). It was then verified that the cod- 
ing efficiency can be improved by 5 to 8 
percent, compared with the traditional 
method. The elimination of the block dis- 
tortion described in the first half of this 
paper can also be applied to the interframe 
prediction of the moving picture. One of 
Che topics for future study is the applica- 
tion of the method to motion compensation. 
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